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USER SELECTIVE ADVERTISING 



FIELD OF THE INVENTION 

This invention relates generally to the field of advertising. More particularly, 
this invention relates to a method of enhancing the effectiveness of advertising 
during playback of stored entertainment content. 

BACKGROUND OF THE INVENTION 

Television advertising spots are typically in the form of commercial segments 
("commercials") in which the entertainment contents such as a television program 
is periodically interrupted to present commercials to the viewer. As used herein, 
the term content is intended to embrace television programming including 
entertainment programming, movies, sporting events, news programs and 
generally anything that would commonly be referred to as a television program. 
This traditional technique for providing advertisements in the form of commercials 
has varying levels of success in reaching the target viewing audience. Although 
demographic and other tools can be utilized to match up appropriate advertising 
with programming, often conventional commercials are not effective since the 
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1 viewer may take the opportunity of a commercial break to, for example, to get a 

2 snack or use the restroom. 

3 Recently, certain television broadcasters, cable networks and videotape 

4 suppliers have utilized so-called "watermarks" to provide the user with a constant 

5 reminder of the source of programming. Such watermarks are logos or insignias 

6 that appear, for example, in the bottom right hand corner of a television image and 

7 generally allow the image to show through the watermark while providing the 

8 viewer with the ability to still clearly see the insignia or logo during most types of 

9 video. Another type of advertisement has also become popular recently with the 

10 advent of the Internet and the worldwide web. So-called banner ads, which may 

1 1 take the form of a scrolling banner at the top, bottom or other location in the video 

12 image (including an open window) provides text or video advertisement. 

13 Unfortunately heretofore, the art of supplying a viewer with an appropriately 

14 targeted advertisement has been totally out of the control of the viewer. This is true 

15 both in the case of selection of advertisement as well as selection of advertising 

16 mechanism. The present invention is intended to address this issue. 
17 

18 

1 9 SUMMARY OF THE INVENTION 

20 The present invention relates generally to advertising. Objects, advantages 

21 and features of the invention will become apparent to those skilled in the art upon 

22 consideration of the following detailed description of the invention. 

23 One embodiment of the present invention relates to an advertisement 

24 method and apparatus in which a user is presented with a menu of advertisements 

25 and/or advertisement types for selection. Upon selection of the desired 

26 advertisement and/or advertisement type, advertisements are downloaded to the 

27 user's set-top box storage for merging with entertainment content for presentation 

28 to the user. 

29 A method of advertising consistent with an embodiment of the invention 

30 includes: presenting a menu of possible advertisements to a user to permit the user 
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1 to select an advertisement to view; receiving a user selection of an advertisement 

2 to view; and merging the advertisement with the stored entertainment content so 

3 that both the advertisement and the stored entertainment content are played back 

4 or presented to the user. 

5 An electronic storage medium containing instructions which, when executed 

6 on a programmed processor carry out a process of advertising consistent with an 

7 embodiment of the invention including: presenting a menu possible advertisements 

8 to a user to permit the user to select an advertisement to view; receiving a user 

9 selection of an advertisement to view; receiving the selected advertisement from 

1 0 an advertising server; and merging the advertisement with the stored entertainment 

1 1 content so that both the advertisement and the stored entertainment content are 

1 2 played back or presented to the user. 

13 A set-top box consistent with one embodiment of the invention includes a 

14 programmed processor that presents a user with a menu of advertisements. A 

15 user selection of a selected advertisement from the menu of advertisements is 

16 received by the user. The selected advertisement is received from a service 

1 7 provider. The content is also received from the service provider. The programmed 

18 processor merges the entertainment content with the advertisement for 

1 9 presentation to the user. 

20 A method of advertising consistent with another embodiment of the invention 

21 includes: presenting a menu of possible types of advertisements to a user to permit 

22 the user to select a type of advertisement to view; receiving a user selection of a 

23 type of advertisement to view; receiving an advertisement of the selected 

24 advertisement type from an advertising server; and merging the advertisement with 

25 the stored entertainment content so that both the advertisement and the stored 

26 entertainment content are presented to the user. 

27 An electronic storage medium containing instructions which, when carried 

28 out by a programmed processor, implements a method of advertising consistent 

29 with the present invention including: presenting a menu of possible types of 

30 advertisements to a user to permit the user to select a type of advertisement to 
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1 view; receiving a user selection of a type of advertisement to view; receiving an 

2 advertisement of the selected advertisement type from an advertising server; and 

3 merging the advertisement with the stored entertainment content so that both the 

4 advertisement and the stored entertainment content are presented to the user. 

5 A set-top box consistent with another embodiment of the invention includes 

6 a programmed processor that presents a user with a menu of advertisement types. 

7 A receiver that receives a user selection of a selected advertisement type from the 

8 menu of advertisements. The selected advertisement is received from a service 

9 provider. The entertainment content is also received from the service provider. The 

1 0 programmed processor merges the entertainment content with the advertisement 

1 1 for presentation to the user. 

12 An advertising method consistent with embodiments of the invention 

1 3 includes: presenting a television viewer with a menu of advertisements from which 

14 to select an advertisement for viewing; receiving an advertisement selection from 

15 the television viewer; and presenting the television viewer with the selected 

16 advertisement. 

1 7 Another advertisement method consistent with embodiments of the invention 

18 includes: presenting the television viewer with a menu of advertisement types; 

1 9 receiving an advertisement type selection from the television viewer; and presenting 

20 the television viewer with the selected advertisement according to the selected 

21 advertisement type. 

22 The above summaries are intended to illustrate exemplary embodiments of 

23 the invention, which will be best understood in conjunction with the detailed 

24 description to follow, and are not intended to limit the scope of the appended 

25 claims. 
26 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 The features of the invention believed to be novel are set forth with 

3 particularity in the appended claims. The invention itself however, both as to 

4 organization and method of operation, together with objects and advantages 

5 thereof, may be best understood by reference to the following detailed description 

6 of the invention, which describes certain exemplary embodiments of the invention, 

7 taken in conjunction with the accompanying drawings in which: 

8 FIGURE 1 is a system block diagram of a system using a set-top box. 

9 FIGURE 2 is a functional block diagram of a digital set-top box suitable for 

1 0 use with the present invention. 

1 1 FIGURE 3 depicts a screen image of an advertisement menu consistent with 

12 certain embodiments of the invention. 

3 FIGURE 4 depicts a screen image of a watermark advertisement consistent 

n|14 with certain embodiments of the invention. 

•J?: 1 5 FIGURE 5 depicts a screen image of a banner advertisement consistent with 

ill 16 certain embodiments of the invention. 

17 FIGURE 6 is a flow chart describing one embodiment of the present 

=f18 invention. 

jJiS FIGURE 7 is a flow chart describing another embodiment of the present 

f|20 invention. 

' 21 FIGURE 8 depicts a screen image of another embodiment of an 

22 advertisement menu and an advertisement type menu consistent with certain 

23 embodiments of the invention. 

24 FIGURE 9 is a flow chart describing another embodiment of the present 

25 invention. 

26 FIGURE 10 is a flow chart describing another embodiment of the present 

27 invention. 
28 

29 
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1 DETAILED DESCRIPTION OF THE INVENTION 

2 While this invention is susceptible of embodiment in many different forms, 

3 there Is shown in the drawings and will herein be described in detail specific 

4 embodiments, with the understanding that the present disclosure is to be 

5 considered as an example of the principles of the invention and not Intended to limit 

6 the Invention to the specific embodiments shown and described. In the description 

7 below, like reference numerals are used to describe the same, similar or 

8 corresponding parts in the several views of the drawings. 

9 Referring to FIGURE 1 , a block diagram for an exemplary Interactive cable 

10 or satellite television (TV) system 100 is shown. The system 100 includes, at a 

1 1 head end of the service provider 1 0, a media server 12 for providing, on demand, 

12 movies and other programming obtained from a media database 14. The media 
|1 3 server 1 2 might also provide additional content such as interviews with the actors, 
^1 4 games, advertisements, available merchandise, associated Web pages, interactive 
^15 games and other related content. The system 100 also includes an electronic 
:j16 programming guide (EPG) server 16 and a program listing database 18 for 
ill? generating an EPG. Set-top box 22 can generally provide for bidirectional 
:|1 8 communication over a transmission medium 20 in the case of a cable STB 22. In 
519 other embodiments, bidirectional communication can be effected using 
pO asymmetrical communication techniques possibly using dual communication 
i21 media - - one for the uplink and one for the downlink. In any event, the STB 22 can 

22 have its own Universal Resource Locator (URL) or IP address or other unique 

23 identifier assigned thereto to provide for addressability by the head end and users 

24 of the Internet. 

25 The media server 12 and EPG server 16 are operatively coupled by 

26 transmission medium 20 to a set-top box (STB) 22. The transmission medium 20 

27 may include, for example, a conventional coaxial cable network, a fiber optic cable 

28 network, telephone system, twisted pair, a satellite communication system, a radio 

29 frequency (RF) system, a microwave system, other wireless systems, a 
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1 combination of wired and wireless systems or any of a variety of known electronic 

2 transmission mediums. In the case of a cable television network, transmission 

3 medium 20 is commonly realized at the subscriber's premises as a coaxial cable 

4 that is connected to a suitable cable connector at the rear panel of the STB 22. In 

5 the case of a Direct Satellite System (DSS), the STB 22 is often referred to as an 

6 Integrated Receiver Decoder (IRD). In the case of a DSS system, the transmission 

7 medium is a satellite transmission at an appropriate microwave band. Such 

8 transmissions are typically received by a satellite dish antenna with an integral Low 

9 Noise Block (LNB) that serves as a down-converter to convert the signal to a lower 

1 0 frequency for processing by the STB 22. 

11 The exemplary system 100 further includes a TV 24, such as a digital 

1 2 television, having a display 26 for displaying programming, an EPG, etc. The STB 
:3 3 22 may be coupled to the TV 24 and various other audio/visual devices 26 (such as 
'§4 audio systems, Personal Video Recorders (PVRs), Video Tape Recorders (VTRs), 
\05 Video Cassette Recorders (VCRs) and the like), storage devices (e.g., hard disc 
;'}16 drives) and Internet Appliances 28 (such as email devices, home appliances, 
iti\7 storage devices, network devices, and other Internet Enabled Appliances) by an 
111 8 appropriate interface 30, which can be any suitable analog or digital interface. In 
L?19 one embodiment, interface 30 conforms to an interface standard such as the 
ligO Institute of Electrical and Electronics Engineers (IEEE) 1394 standard, but could 
|]kl also be wholly or partially supported by a DVI interface (Digital Visual Interface - 

22 Digital Display Working Group, www.ddwg.org) or other suitable interface. 

23 The STB 22 may include a central processing unit (CPU) such as a 

24 microprocessor and memory such as Random Access Memory (RAM), Read Only 

25 Memory (ROM), flash memory, mass storage such as a hard disc drive, floppy disc 

26 drive, optical disc drive or may accommodate other electronic storage media, etc. 

27 Such memory and storage media is suitable for storing data as well as instructions 

28 for programmed processes for execution on the CPU, as will be discussed later. 

29 Information and programs stored on the electronic storage media or memory may 

30 also be transported over any suitable transmission medium such as that illustrated 
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1 as 20. STB 22 may include circuitry suitable for audio decoding and processing, 

2 the decoding of video data compressed in accordance with a compression 

3 standard such as the Motion Pictures Experts Group (MPEG) standard and other 

4 processing to form a controller or central hub. Alternatively, components of the 

5 STB 22 may be incorporated into the TV 24 itself, thus eliminating the STB 22. 

6 Further, a computer having a tuner device and modem may be equivalently 

7 substituted for the TV 24 and STB 22. 

8 By way of example, the STB 22 may be coupled to devices such as a 

9 personal computer, video cassette recorder, camcorder, digital camera, personal 

10 digital assistant and other audio/visual or Internet related devices. In addition, a 

1 1 data transport architecture, such as that set forth by an industry group which 

12 includes Sony Corporation and known as the Home Audio-Video Interoperability 
'tfl3 (HAVi) architecture may be utilized to enable interoperability among devices on a 
l$4 network regardless of the manufacturer of the device. This forms a home network 
11115 system wherein electronic devices and Internet appliances are compatible with 
f jS each other. The STB 22 runs an operating system suitable for a home network 
^^^^7 system such as Sony Corporation's Aperies™ real time operating system. Other 
dri8 operating systems could also be used. 

;;v J19 The STB 22 includes an infrared (IR) receiver 34 for receiving IR signals from 

fpO an input device such as remote control 36. Alternatively, it is noted that many other 

1^1 control communication methods may be utilized besides IR, such as wired or 

22 wireless radio frequency, etc. In addition, it can be readily appreciated that the 

23 input device 36 may be any device suitable for controlling the STB 22 such as a 

24 remote control, personal digital assistant, laptop computer, keyboard or computer 

25 mouse. In addition, an input device in the form of a control panel located on the TV 

26 24 or the STB 22 can be provided. 

27 The STB 22 may also be coupled to an independent service provider (ISP) 

28 host 38 by a suitable connection including dial-up connections, DSL (Digital 

29 Subscriber Line) orthe same transmission medium 20 described above (e.g., using 

30 a cable modem) to, thus, provide access to services and content from the ISP and 
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1 the Internet. The ISP host 38 provides various content to the user that is obtained 

2 from a content database 42. STB 22 may also be used as an Internet access 

3 device to obtain information and content from remote servers such as remote 

4 server 48 via the Internet 44 using host 38 operating as an Internet portal, for 

5 example. In certain satellite STB environments, the data can be downloaded at 

6 very high speed from a satellite link, with asymmetrical upload speed from the set- 

7 top box provided via a dial-up or DSL connection, 

8 While the arrangement illustrated in FIGURE 1 shows a plurality of servers 

9 and databases depicted as independent devices, any one or more of the servers 

1 0 can operate as server software residing on a single computer. Moreover, although 

1 1 not explicitly illustrated, the servers may operate in a coordinated manner under 

12 centralized or distributed control to provide multiple services as a Multiple Service 
|l3 Operator (MSO) in a known manner. Additionally, the services provided by the 
i|l4 servers shown in FIGURE 1 may actually reside in other locations, but from the 
Vl 5 perspective of the user of STB 22, the service provider 1 0 serves as a portal to the 
016 services shown. Those skilled in the art will appreciate that the illustration of 

7 FIGURE 1 represents a simplified depiction of a cable system configuration shown 

3l8 simply as service provider 10, The actual configuration of the service provider's 

:j19 equipment is more likely to follow a configuration defined by the CableLabs 

|20 OpenCable™ specification. The simplified illustration shown is intended to simplify 

-21 the discussion of the service provider 10's operation without unnecessarily 

22 burdening the discussion with architectural details that will be evident to those 

23 skilled in the art. Those details can be found in the publicly available CableLabs 

24 OpenCable™ specification or in the text "OpenCable Architecture (Fundamentals)" 

25 by Michael Adams, Cisco Press, Nov. 1999. 

26 Referring now to FIGURE 2, a typical system configuration for a digital set- 

27 top box 22 is illustrated. In this exemplary set-top box, the transmission medium 

28 20, such as a coaxial cable, is coupled by a suitable interface through a diplexer 

29 1 02 to a tuner 1 04. Tuner 1 04 may, for example, include a broadcast in-band tuner 
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1 for receiving content, an out-of-band (OOB) tuner for receiving data transmissions. 

2 A return path through diplexer 1 02 provides an OOB return path for outbound data 

3 (destined for example for the head end). A separate tuner (not shown) may be 

4 provided to receive conventional RF broadcast television channels. Modulated 

5 information formatted, for example, as MPEG-2 information is then demodulated 

6 at a demodulator 1 06. The demodulated information at the output of demodulator 

7 106 is provided to a demultiplexer and descrambler circuit 110 where the 

8 information is separated into discrete channels of programming. The programming 

9 is divided into packets, each packet bearing an identifier called a Packet ID (RID) 

10 that identifies the packet as containing a particular type of data (e.g., audio, video, 

11 data). The demodulator and descrambler circuit 110 also decrypts encrypted 

12 information in accordance with a decryption algorithm to prevent unauthorized 
3 access to programming content, for example. 

Audio packets from the demultiplexer 110 (those identified with an audio 

fills PID) are decrypted and forwarded to an audio decoder 114 where they may be 

l'A6 converted to analog audio to drive a speaker system (e.g., stereo or home theater 

^^7 multiple channel audio systems) or other audio system 116 (e.g., stereo or home 

yfl8 theater multiple channel amplifier and speaker systems) or may simply provide 

f'19 decoded audio out at 118. Video packets from the demultiplexer 110 (those 

fpO identified with a video PID) are decrypted and forwarded to a video decoder 122. 

|21 In a similar manner, data packets from the demultiplexer 110 (those identified with 

22 a data PID) are decrypted and forwarded to a data decoder 126. 

23 Decoded data packets from data decoder 126 are sent to the set-top box's 

24 computer system via the system bus 1 30. A central processing unit (CPU) 1 32 can 

25 thus access the decoded data from data decoder 126 via the system bus 130. 

26 Video data decoded by video decoder 1 22 is passed to a graphics processor 1 36, 

27 which is a computer optimized to processes graphics information rapidly. Graphics 

28 processor 136 is particularly useful in processing graphics intensive data 

29 associated with Internet browsing, gaming and multimedia applications such as 

30 those associated with MHEG (Multimedia and Hypermedia information coding 
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1 Experts Group) set-top box applications. It should be noted, however, that the 

2 function of graphics processor 136 may be unnecessary in some set-top box 

3 designs having lower capabilities, and the function of the graphics processor 136 

4 may be handled by the CPU 1 32 in some applications where the decoded video is 

5 passed directly from the demultiplexer 11 0 to a video encoder. Graphics processor 

6 1 36 is also coupled to the system bus 1 30 and operates under the control of CPU 

7 132. 

8 Many set-top boxes such as STB 22 may incorporate a smart card reader 

9 1 40 for communicating with a so called "smart card," often serving as a Conditional 

1 0 Access Module (CAM). The CAM typically includes a central processor unit (CPU) 

1 1 of its own along with associated RAM and ROM memory. Smart card reader 140 

12 is used to couple the system bus of STB 22 to the smart card serving as a CAM 
^^^3 (not shown). Such smart card based CAMs are conventionally utilized for 
^fl 4 authentication of the user and authentication of transactions carried out by the user 
fill 5 as well as authorization of services and storage of authorized cryptography keys. 
}'jl6 For example, the CAM can be used to provide the key for decoding incoming 
Hll 7 cryptographic data for content that the CAM determines the user is authorized to 
I jl 8 receive. 

;|l 9 STB 22 can operate in a bidirectional communication mode so that data and 

1^0 other information can be transmitted not only from the system's head end to the 

|Sl end user, or from a service provider to the end user of the STB 22, but also, from 

22 the end user upstream using an out-of-band channel. In one embodiment, such 

23 data passes through the system bus 130 to a modulator 144 through the diplexer 

24 102 and out through the transmission medium 20. This capability is used to 

25 provide a mechanism for the STB 22 and/or its user to send information to the head 

26 end (e.g., service requests or changes, registration information, etc.) as well as to 

27 provide fast outbound communication with the Internet or other services provided 

28 at the head end to the end user. 

29 Set-top box 22 may include any of a plurality of I/O (Input/Output) interfaces 

30 represented by I/O interfaces 146 that permit interconnection of I/O devices to the 
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1 set-top box 22. By way of example, and not limitation, a serial RS-232 port 1 50 can 

2 be provided to enable interconnection to any suitable serial device supported by the 

3 STB 22's internal software. Similarly, communication with appropriately compatible 

4 devices can be provided via an Ethernet port 1 52, a USB (Universal Serial Bus) port 

5 1 54, an IEEE 1 394 (so-called firewire™ or i-link™) or IEEE 1 394 wide port 1 56, S- 

6 video port 1 58 or infrared port 1 60. Such interfaces can be utilized to interconnect 

7 the STB 22 with any of a variety of accessory devices such as storage devices, 

8 audio / visual devices 26, gaming devices (not shown), Internet Appliances 28, etc. 

9 I/O interfaces 146 can include a modem (be it dial-up, cable, DSL or other 

1 0 technology modem) having a modem port 1 62 to facilitate high speed or alternative 

1 1 access to the Internet or other data communication functions. In one preferred 

12 embodiment, modem port 162 is that of a DOCSIS (Data Over Cable System 
ijl3 Interface Specification) cable modem to facilitate high speed network access over 
ifl 4 a cable system, and port 1 62 is appropriately coupled to the transmission medium 
yi5 20 embodied as a coaxial cable. Thus, the STB 22 can carry out bidirectional 
Jj16 communication via the DOCSIS cable modem with the STB 22 being identified by 
"17 a unique IP address. The DOCSIS specification is publically available. 

Jl8 A PS/2 or other keyboard / mouse / joystick interface such as 164 can be 

il 9 provided to permit ease of data entry to the STB 22. Such inputs provide the user 

feo with the ability to easily enter data and/or navigate using pointing devices. Pointing 

^21 devices such as a mouse or joystick may be used in gaming applications. 

22 Of course, STB 22 also may incorporate basic video outputs 1 66 that can be 

23 used for direct connection to a television set such as 24 instead of (or in addition 

24 to) an IEEE 1394 connection such as that illustrated as 30. In one embodiment, 

25 Video output 166 can provide composite video formatted as NTSC (National 

26 Television System Committee) video. In some embodiments, the video output 1 66 

27 can be provided by a direct connection to the graphics processor 136 or the 

28 demultiplexer / descrambler 1 1 0 rather than passing through the system bus 1 30 

29 as illustrated in the exemplary block diagram. S-Video signals from output 1 58 can 

30 be similarly provided without passing through the system bus 1 30 if desired in other 
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1 embodiments. 

2 The infrared port 160 can be embodied as an infrared receiver 34 as 

3 illustrated in FIGURE 1, to receive commands from an infrared remote control 36, 

4 infrared keyboard or other infrared control device. Although not explicitly shown, 

5 front panel controls may be used in some embodiments to directly control the 

6 operation of the STB 22 through a front panel control interface as one of interfaces 

7 146. Selected interfaces such as those described above and others can be 

8 provided in STB 22 in various combinations as required or desired. 

9 STB 22 will more commonly, as time goes on, include a disc drive interface 

10 1 70 and disc drive mass storage 1 72 for user storage of content and data as well 

1 1 as providing storage of programs operating on CPU 1 32. STB 22 may also include 

12 floppy disc drives, CD ROM drives, CD RA/V drives, DVD drives, etc. CPU 1 32, in 
IS 3 order to operate as a computer, is coupled through the system bus 1 30 (or through 
=|14 a multiple bus architecture) to memory 176. Memory 178 may include a 
fpIS combination any suitable memory technology including Random Access Memory 
IjAS (RAM), Read Only Memory (ROM), Flash memory. Electrically Erasable 
•^1 7 Programmable Read Only Memory (EEPROM), etc. 

1318 While the above exemplary system including STB 22 is illustrative of the 

ia19 basic components of a digital set-top box suitable for use with the present 

!|20 invention, the architecture shown should not be considered limiting since many 

M21 variations of the hardware configuration are possible without departing from the 

22 present invention. The present invention could, for example, also be implemented 

23 in more advanced architectures such as that disclosed in U.S. Patent Application 

24 Serial No. 09/473,625, filed Dec. 29, 1999, Docket No. SONY-50N3508 entitled 

25 "Improved Internet Set-Top Box Having and In-Band Tuner and Cable Modem" to 

26 Jun Maruo and Atsushi Kagami. This application describes a set-top box using a 

27 multiple bus architecture with a high level of encryption between components for 

28 added security. This application is hereby incorporated by reference as though 

29 disclosed fully herein. 

30 In general, during operation of the STB 22, an appropriate operating 
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1 systemi 80 such as, for example, Sony Corporation's Aperios™ real time operating 

2 system is loaded into, or is permanently stored in, active memory along with the 

3 appropriate drivers for communication with the various interfaces, in other 

4 embodiments, other operating systems such as Microsoft Corporation's Windows 

5 CE™ could be used without departing from the present invention. Along with the 

6 operating system and associated drivers, the STB 22 usually operates using 

7 browser software 182 in active memory or may permanently reside in ROM, 

8 EEPROM or Flash memory, for example. The browser software 182 typically 

9 operates as the mechanism for viewing not only web pages on the Internet, but 

10 also serves as the mechanism for viewing an Electronic Program Guide (ERG) 

11 formatted as an HTML document. The browser 182 can also provide the 

12 mechanism for viewing normal programming (wherein normal programming is 
|l 3 viewed as an HTML video window - often occupying the entire area of screen 26). 
#14 STB software architectures vary depending upon the operating system. 
015 However, in general, all such architectures generally include, at the lowest layer, 
"Jl 6 various hardware interface layers. Next is an operating system layer as previously 
ill 7 described. The software architectures of modern STB have generally evolved to 
111 8 include a next layer referred to as "middleware." Such middleware permits 
J19 applications to run on multiple platforms with little regard for the actual operating 
U20 system in place. Middleware standards are still evolving at this writing, but are 
5l commonly based upon Javascript and HTML (hypertext Markup Language) virtual 

22 machines. At the top layer is the application layer where user applications and the 

23 like reside (e.g., browsing, email, ERG, Video On Demand (VOD), rich multimedia 

24 applications, pay per view, etc.). The current invention can be utilized with any 

25 suitable set-top box software and hardware architecture. 

26 In accordance with embodiments of the invention, the user is given various 

27 options regarding the type of advertisement as well as how the advertisement is 

28 presented. While the user still has to be presented with advertisements, he or she 

29 can exercise a preference for both advertiser and advertisement type. Referring 

30 back to FIGURE 1 , in addition to media server 1 2, ERG server 1 6 and ISP host 38, 

Docket No.: SNY-P41 46 -14- PATENT 



1 the service provider 1 0 includes an advertising server 56 that includes a database 

2 of advertisements 58 for presentation to the ultimate viewer. Servers 12, 16 and 

3 56 as well as ISP host 38 although shown as independent servers with 

4 independent databases may be implemented in any suitable manner including 

5 implementation on more or fewer computers than those illustrated. Moreover, 

6 these servers generally operate in a coordinated manner to provide the services 

7 described herein. The actual hardware configuration at the service provider head 

8 end may differ substantially than that shown without departing from the present 

9 invention. 

1 0 Referring now to FIGURE 3, a screen image illustrating one embodiment of 

1 1 the present invention is shown as 300 as it might appear on display 26. In this 

12 embodiment, the user is presented with a plurality of possible advertisements 
3 shown as 302 through 324 and is instructed by an instruction area 330 to select the 

3 4 particular number of advertisements to be viewed during a presentation of 

fill 5 programming that follows. For example, in the example shown as 300, the user is 

1^6 presented with 12 possible advertisements to be presented during a professional 

'^7 soccer event and the user is given 30 seconds in which to select 5 of the 

1318 advertisements. 

^ Si 9 As shown, the available advertisements include advertisements for multiple 

H^O advertisers as well as multiple formats. Menu icons representing advertisements 

1^1 302, 304 and 306 are, for example from the same advertiser with three different 

22 advertisement types (conventional commercial segment, banner or watermark), but 

23 other types of advertisements (e.g. panel advertisement that repeatedly pop up as 

24 a window on the screen for several seconds) can also be used. Similarly, 

25 Advertisement groups 312 and 314; 316 and 318; and 320, 322 and 324 depict 

26 advertisements of varying types for the same advertiser. Conventional commercial 

27 segment type advertisements are depicted by menu selection icons 302, 308, 31 0, 

28 312,316 and 320. Banner type advertisements are represented by menu selection 

29 icons 304, 31 4 and 322. Watermark type advertisements are represented by menu 

30 selection icons 306, 314, 318 and 322. Thus, for example, if the user selects 320, 
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1 a conventional commercial segment will interrupt the presentation periodically. If 

2 the user selects menu icon 322, a banner advertisement will appear either during 

3 presentation of the programming material or as a substitute for the commercial 

4 segment during the time slot normally occupied by such a commercial segment. 

5 Finally, if the user selects menu icon 324, a logo will be displayed as a watermark 

6 throughout at least a portion of the programming. In this manner, the user can 

7 select from among various advertisers and types of advertising to both optimize the 

8 presentation of information to the viewer (because the viewer gets to select items 

9 that might be of interest) as well as selecting the advertising mechanism. Thus, the 

10 user can determine if he wishes to view a full advertisement, or view a less 

11 intrusive form of advertisement such as a watermark. The actual level of 

12 intrusiveness of any particular type of advertisement depends upon a number of 
3 factors including the size of a banner or watermark, etc. 

'fl4 The user, for example, may desire to see a full commercial message for 

rin 5 some advertisers and thus accept a 30-second or 1 minute (or more or less) of an 

f:^}l6 interruption in the programming content periodically. If, however, the user prefers 
to view the content substantially uninterrupted, he may wish to trade off the 

iM 8 interruption time for a longer presentation of a banner advertisement or perhaps an 

J59 even longer display of a watermark type advertisement. It is contemplated, for 

iy20 example, that a 30-second commercial interruption might be traded off for a longer 

U21 presentation (e.g. perhaps 5 minutes) of banners or an even longer presentation 

22 (e.g. 20 minutes) watermark advertisement. In general, it is contemplated that 

23 more intrusive advertisements can be shown for shorter times than more intrusive 

24 advertisements. In any case, the user has the option to select the preferred 

25 advertising mechanism and perhaps more importantly, to not be bothered with 

26 advertisements that are of no interest. Moreover, the service provider is given the 

27 flexibility of providing varying types of advertisements for varying lengths of time 

28 with perhaps differing charges to the advertiser. 

29 The present invention can thus be implemented through use of the 

30 programmed processor CPU 1 32 of set-top box 22 with the user making selections 
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1 of the appropriate advertisements utilizing remote control 36 to navigate through the 

2 menu of advertisements shown in FIGURE 3 (or any other suitable menu system). 

3 When an appropriate advertisement is to be selected, it can be highlighted or 

4 pointed to and selected using a select or enter key in the remote control 306. Upon 

5 doing so, the selections can be shown on the screen by highlighting. A highlighted 

6 selection is illustrated in menu selection representing advertisement 302, but the 

7 selection can, of course, be otherwise noted as having been selected. If the user 

8 fails to make appropriate selections, a default set of advertisements selected by the 

9 service provider 10 are used instead. However, those advertisements can be 

10 targeted using user profiles and other techniques. 

11 In accordance with this embodiment, selected advertisements can be 

1 2 provided to the user in a number of ways. For example, the advertisements can be 
: j3 downloaded in parallel with the presentation of programming material by use of a 

cable modem within set-top box 22 and stored in disc drive 172 until time for 

fl}l5 presentation of any particular advertisement in any particular medium. Thus, a 

f:i16 watermark or a banner advertisement or a 30-second conventional commercial 

7 could be stored in disc drive 1 72 (or in another disc drive attached to the set-top box 

1318 22 as, for example, in the case of a personal video recorder) and played back at 

3 9 appropriate times either during a pause in the programming or by merging with the 

l|SO content in another manner. 

lh^ By way of example, the information needed to present a banner 

22 advertisement or watermark can be downloaded to disc drive 1 72 and mixed with 

23 the incoming video for playback on the user's television 24. In the case of a 

24 commercial interruption, the video content being transmitted from the service 

25 provider 1 0 can be cached locally so that real time presentation of the video is not 

26 necessary. The content can include a marker whenever a certain type of 

27 advertisement is to be displayed. In other embodiments, rather than downloading 

28 the advertisements via the modem, the advertisements can be made available on 

29 unused channels in the video stream for merging with the active video of the 

30 entertainment content. Those skilled in the art will recognize many mechanisms 
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1 for providing the advertising content and the entertainment content and merging 

2 these two elements together to create the final images displayed to the viewer. 

3 Referring now to FIGURE 4, a screen image 400 displaying active video of 

4 programming content is illustrated in which a watermark 424 corresponding to 

5 selection 324 is illustrated. Although illustrated near the bottom right-hand corner 

6 of the display image, this should not be considered limiting. It is contemplated that 

7 the watermark may appear in other locations and, in fact, may move around the 

8 screen image or appear at various times in different locations to provide for a more 

9 effective presentation of the logo or other image used in the watermark. 

10 Referring now to FIGURE 5, a screen image 500 again with active 

11 entertainment content video playing simultaneously includes a banner style 

12 advertisement 522 corresponding to selection 322 from screen image 300. 
15 3 Although the banner advertisement appears at the lower portion of screen 500, it 
.3l4 could also appear within a window or a banner located anywhere on the screen. 
}\H5 One method for implementing the process just described is shown in 
|d16 FIGURE 6 as process 600. The process starts at 604 after which the user is 
^^^7 presented with a menu of advertisements at 610 such as the menu shown in 
^3l8 screen image 300. At 614, immediately upon presenting the user with the menu 
'0 9 of advertisements, a timer is initiated. In the example shown in screen image 300, 
;S0 this timer might be a 30-second timer (and may be accompanied by an audible 
1^1 alert to the user), but this is not to be considered limiting since any appropriate time 

22 period can be used. At 618, during the time period when the timer is active, the 

23 user selects the advertisers and/or types of advertisements to be presented and is 

24 able to continue this process until 622 when the timer expires. Depending upon the 

25 embodiment, the user's selection of advertisements may be sent back to the 

26 service provider 1 0 or used at the set-top box 22 to carry out the process of the 

27 present invention. In one embodiment, the advertisements are merged with the 

28 entertainment content at the STB 22 for presentation to the user. In another 
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1 embodiment, the advertisements are merged witli the content at the service 

2 provider head end for presentation to the user (e.g., in a pay per view environment). 

3 When the timer expires at 622, the system (for example, the CPU 1 32 of set- 

4 top box 22 operating under program control) determines if the user selected the 

5 correct number of advertisements (in the example shown, the correct number is 5). 

6 If not, the processor within the set-top box or a processor at the service provider 1 0 

7 makes selections of additional advertisements to present to the user at 630 (e.g. 

8 randomly or according to any suitable criterion). Once its total number of 

9 advertisements corresponding to the number needed for presentation during the 

10 entertainment content is selected either at 624 or 630, the entertainment content 

11 begins playing at 634. Possibly simultaneously, the advertisements are 

12 downloaded at 638 from the service provider either via a channel that is designated 
jl3 for download of advertisements or via cable modem (DOCSIS or Out Of Band 
fl 4 modem for example). 

[ri5 At 644, the advertisements are merged with the entertainment content for 

Jil 6 play to the user until the end of the entertainment content is reached at 650. Once 

^7 the entertainment content is completed at 650, control returns to 610 for 

■118 presentation of the next menu of advertisements in one embodiment. In other 

%9 embodiments the present technique may only be used in certain entertainment 

|feO content. In this case the process ends after 650. Numerous variations to this 

^21 process (including parallel processing, reordering of the process and other 

22 variations) will occur to those skilled in the art upon consideration of this invention, 

23 without departing from the invention. 

24 Referring now to FIGURE 7, a method embodying an alternate embodiment 

25 of the present invention is illustrated as process 700 starting at 704. At 708 the 

26 user, for example using a dedicated button on remote control 36, activates a 

27 process to select advertisements. This causes the user to be presented with a 

28 menu of advertisements at 712, for example, for the current entertainment content 

29 being viewed. At 71 8, the user selects an advertiser and/or a type of advertisement 

30 that he or she wishes to view. Thus, the present embodiment operates to permit 
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1 the user to modify the current presentation of advertising content or make new 

2 selections, for example, to see a previously viewed advertisement. 

3 At 724, if the correct number of advertisements has not been selected, 

4 control passes to 730 where the remaining advertisements required are selected 

5 by the system as in the previous process. In either event, control passes from 724 

6 or 730 to 734 where the entertainment content is started or continued and the 

7 appropriate advertisements are downloaded at 738 either on a dedicated channel 

8 for advertisements or downloaded via modem. At 744, the advertisements are 

9 merged with the entertainment content for display to the viewer until done at 750, 

10 At 750, when the content is completed, the user may be presented with an 

1 1 additional menu of advertisements at 71 2 or the process may simply terminate until 

12 the user again activates a selection on the remote control to enter stage 708. 
^3 Again, many variations of this process are possible within the scope of the 
^^4 invention. 

jl5 Referring now to FIGURE 8, a screen image 800 illustrates another 

j\6 mechanism for selection of appropriate types of advertisement content. In this 

^7 embodiment, the user is independently or dependently presented with a menu of 

ll 8 types of advertisements as well as a menu of advertisements. In one embodiment 

il 9 of the implementation of the current embodiment, a scrolling menu of icons 804 is 

120 periodically presented to the user during the presentation of the entertainment 

.*21 content. The presentation appears to the user much like a "tickertape" of 

22 advertisement selections. The user can then make a selection from the scrolling 

23 menu for the next advertisement to be presented. In addition, the user can be 

24 presented with a menu of advertisement types from which to select for the next 

25 advertisement. Thus, for example, using navigation tools available through the 

26 remote control 36, the user might highlight the selection of advertisement 81 0 from 

27 the scrolling menu 804 while selecting a banner, watermark, or in this case, 

28 commercial advertisement from the window 814, depending on the level of 

29 intrusiveness of the advertisement the user is prepared to accept. 
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1 At this point, it is contemplated that the screen would clear except for the 

2 entertainment content. Upon reaching the next appropriate marker within the 

3 entertainment content, a commercial segment or other type of advertisement will 

4 be viewed for the advertiser identified in icon 810. The variation illustrated in 

5 FIGURE 8 is described as process 900 depicted in FIGURE 9. This process starts 

6 at 904 after which the system begins to play content at 908. Prior to a time for 

7 presentation of an advertisement, the user is presented with a menu of 

8 advertisements at 912. At 918 the user selects an advertisement during the 

9 presentation of the menu or else ignores the selection in which case the system 

1 0 selects an appropriate advertisement at 930 by any suitable selection mechanism 

1 1 {for example, rotation or targeted advertisement based on a user profile or content 

12 profile or time of day.) 

33 In either event, control passes from 918 or 930 to 934 where the 

^4 entertainment content continues while the appropriate advertisement is 

iM 5 downloaded from the advertisement server 56 at the service provider 1 0 at 938. At 

J| 6 944 the advertisement is merged with the entertainment content for playback to the 

^ 7 viewer until time for the next advertisement is reached at 950 at which point control 

;|8 returns to 912 where a new menu of advertisements is presented to the user. 

49 Many variations are possible without departing from the present invention. For 

Jo example, although the download of advertisements has been depicted as occurring 

:^1 simultaneous with the play of entertainment content, the advertisements could be 

22 downloaded at high speed prior to the beginning of play, in another embodiment, 

23 the user's disc storage 172 (or other storage associated with the user's system) 

24 can be used as a cache for a substantial body of advertisements. Thus, in some 

25 situations, an advertisement may not need to be downloaded at all in order to 

26 merge the advertisements with the entertainment content. In other embodiments, 

27 advertisements can be embedded within the blanking interval of a conventional 

28 analog television signal and played back after selection in accordance with any 

29 suitable selection mechanism by the user. These and other variations will become 

30 evident to those skilled in the art upon consideration of the present invention. 
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1 It is contemplated that the ability to present advertisements in a variety of 

2 ways to the user will impact the business methods of the service providers and/or 

3 networks so that the charges (made from the service provider or network to the 

4 advertisers) associated with presentation of advertisements can be impacted by the 

5 type of advertisement presented. Moreover, with experience and testing, it can be 

6 determined how the effectiveness of various types of advertisements compare so 

7 that fee structures and times for the various advertisements can be factored into the 

8 business model. For example, as previously noted, a 30 second conventional 

9 advertisement might be as valuable as a 5 minute banner advertisement or a 20 

10 minute watermark. Thus, charges for advertisements can be adjusted to provide 

11 availability to businesses having smaller amounts of funds to spend on 

12 advertisement. Consider for example, a pool of 5 local advertisers that might 
51 3 advertise for one minute each as a banner advertisement at substantially reduced 
fl 4 prices. Many variations are possible without departing from the present invention. 
IflS Those skilled in the art will recognize that the present invention has been 
36 described in terms of exemplary embodiments based upon use of a programmed 
V\7 processor. However, the invention should not be so limited, since the present 
:^|I8 invention could be implemented using hardware component equivalents such as 
J19 special purpose hardware and/or dedicated processors which are equivalents to 
150 the invention as described and claimed. Similarly, general purpose computers, 
Si microprocessor based computers, micro-controllers, optical computers, analog 

22 computers, dedicated processors and/or dedicated hard wired logic may be used 

23 to construct alternative equivalent embodiments of the present invention. 

24 Referring now to FIGURE 10, an alternative embodiment is illustrated as 

25 process 1 000 starting at 1 004 wherein a pay-per-view embodiment is illustrated in 

26 which the entertainment content and the advertisement is merged at the service 

27 provider. In this embodiment, the user selects a pay-per-view, video on demand 

28 or similar entertainment content selection at 1 008. At 1 01 2, the user is presented 

29 with a menu of possible advertisements as described previously. The user then 

30 selects advertisements from the menu at 1018, possibly within a given time limit 
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1 as described previously. If the user fails to do so within prescribed limits, the 

2 system selects advertisements instead at 1 030. In either case, the advertisements 

3 are then merged with the entertainment content at 1044 at the service provider 

4 (e.g., within media server 12) and the merged content is then presented to the user 

5 at 1 050 from the service provider. The process then returns at 1 060. Those skilled 

6 in the art will appreciate many variations in the present embodiment without 

7 departing from the invention. 

8 Those skilled in the art will appreciate that the program steps used to 

9 implement the embodiments described above can be implemented using disc 

10 storage as well as other forms of storage including Read Only Memory (ROM) 

11 devices, Random Access Memory (RAM) devices; optical storage elements, 

1 2 magnetic storage elements, magneto-optical storage elements, flash memory, core 
33 memory and/or other equivalent storage technologies without departing from the 
^4 present invention. Such alternative storage devices should be considered 
il5 equivalents. 

J{|6 The present invention is preferably implemented using a programmed 

Ik 7 processor executing programming instructions that are broadly described above in 

$ 8 flow chart form. However, those skilled in the art will appreciate that the processes 

39 described above can be implemented in any number of variations and in many 

£20 suitable programming languages without departing from the present invention. For 

%^ example, the order of certain operations carried out can often be varied, portions 

22 can be deleted or carried out in parallel, and additional operations can be added 

23 without departing from the invention. Error trapping can be added and/or enhanced 

24 and variations can be made in user interface and information presentation without 

25 departing from the present invention. Such variations are contemplated and 

26 considered equivalent. 

27 While the invention has been described in conjunction with specific 

28 embodiments, it is evident that many alternatives, modifications, permutations and 

29 variations will become apparent to those skilled in the art in light of the foregoing 

30 description. Accordingly, it is intended that the present invention embrace all such 
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1 alternatives, modifications and variations as fall witlnin the scope of the appended 

2 claims. 

3 What is claimed is: 
4 

5 
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